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ABSTRACT 

We  overview  the  desirable  features  of  a  ranking  and  a  selection  methodology,  taking  several  criteria  into 
account.  We  show  to  what  extent  the  class  of  PROMETHEE  methods  is  presenting  these  features.  We 
summarize  the  recommendations  which  were  formulated  a  few  years  ago,  in  order  to  adapt  these  methods 
to  their  use  for  military  equipment  acquisition. 

These  adaptations  are  primarily  related  to  the  choice  of  the  criteria  hierarchy,  the  determination  of 
weights,  the  transformation  and  rescaling  functions,  the  indifference  and  preference  thresholds  and  some 
other  technical  parameters. 

Then  we  discuss  the  capabilities  of  the  PROMETHEE  methods  to  perform  stability  analysis  of  the  ranking 
with  respect  to  the  weights  and  its  relevance  for  the  acquisition  process  of  military  equipment. 

Finally  we  discuss  the  interpretation  of  the  results  given  by  these  PROMETHEE  methods. 

INTRODUCTION 

Outranking  methods  for  multicriteria  decision  aid  belong  typically  to  the  so-called  European  School  of 
Multicriteria  Decision  Making  (MCDM),  which  came  into  existence  with  the  stimulating  work  of  B.  Roy 
([13], [14], [15], [16]).  The  outranking  approach  is  based  on  a  fundamental  partial  comparability  axiom 
where  incomparability  is  a  key  concept  ([5],  p.80).  In  contrast  with  this  approach  there  is  the  so-called 
American  School  in  which  Th.  Saaty  plays  an  important  role  with  his  “Analytical  Hierarchy  Process” 
(AHP  Method)  in  which  there  is  no  place  for  incomparabilities  [17].  In  the  European  School  we  think  that 
incomparabilities  between  alternatives  to  be  ranked  or  to  be  selected,  are  a  natural  aspect  of  any  MCDM 
problem,  in  which  criteria  evaluating  the  performance  of  these  alternatives  are  conflicting  -  meaning  that 
for  instance  two  different  criteria  can  have  inversed  preferences  between  couples  of  the  same  alternatives. 
If  this  happens  on  a  large  set  of  couples  of  criteria,  then  we  claim  that  neglecting  these  conflicts,  is 
leading  to  decisions  which  are  often  far  from  the  original  data  of  the  MCDM  problem.  Although  the  final 
objective  in  practice  is  to  decide  about  a  ranking  or  about  a  selection  of  a  subset  of  the  alternatives,  we 
claim  that  the  decision  maker  should  be  supported  by  methods  which  are  warning  about  the  presence  of 
incomparabilities.  We  even  claim  that  it  should  be  possible  to  assess  the  importance  (the  intensity)  of 
these  incomparibilities  in  order  to  fully  inform  the  decision  maker  about  it,  before  the  final  decision  is 
made. 

Many  different  methods  belong  to  the  outranking  class.  For  overviews  we  refer  to  [5],  [18]  and  [19].  For  a 
detailed  description  of  industrial  applications  with  the  oldest  member  (ELECTRE)  of  this  class  we  refer  to 
[11].  In  this  paper  we  will  concentrate  on  the  well-known  PROMETHEE  methods.  In  other  contributions 
to  the  NATO  SAS-080  Specialist  Meeting  (Brussels,  22-23  October  2009)  we  will  focus  on  the  ORESTE 
method  ([10], [12])  which  is  complementary  to  the  PROMETHEE  methods.  There  are  other  methods 
belonging  to  the  European  School  like  MACBETH  [1]  which  in  SAS-080  is  the  subject  of  a  keynote 
address  by  C.  Bana  e  Costa. 
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Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 
VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  OMB  control  number. 
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The  PROMETHEE  methods  are  sufficiently  well-known  by  System  Analysis  specialists,  to  skip  in  this 
paper  all  mathematical  aspects.  For  details  we  refer  to  [4], [8]  and  [9];  for  some  more  philosophical 
considerations  see  [3]. 

The  PROMETHEE  methods  have  been  extensively  used  in  the  eighties  and  nineties  of  last  century  by 
teams  of  Belgian  MoD  equipment  acquisition  services.  These  (and  other)  MCDM  methods  are  taught  in 
the  curriculum  of  the  High  Staff  College  for  Military  Administrators  of  the  Belgian  MoD.  Currently 
personnel  involved  with  equipment  acquisition  can  use  these  methods  on  an  individual  basis.  For  other 
areas  in  Defence  where  these  methods  were  used,  we  refer  for  instance  to  [6]. 

In  this  paper  we  concentrate  on  practical  features  of  PROMETHEE,  the  typical  use  for  military  equipment 
acquisition,  and  we  illustrate  the  discussion  primarily  by  an  implementation  we  called  MCDMTool  [7]. 


MILITARY  EQUIPMENT  ACQUISITION  CRITERIA 

Criteria  to  assess  or  evaluate  military  equipment  to  be  acquired  by  the  MoD  are  to  a  large  extent  the  same 
as  those  used  in  logistics  engineering  and  management.  Therefore  we  refer  to  [2]  (  Appendix  B)  for  a  very 
detailed  checklist  of  criteria,  and  to  [2]  (Appendix  C)  for  a  very  detailed  checklist  of  criteria  for  the 
evaluation  of  suppliers.  In  Figure  1  is  shown  an  example  of  10  alternative  equipments  assessed  on  a 
hierarchy  of  typical  criteria. 


Figure  1 :  MCDMTool  criteria  hierarchy 
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DESIRED  FEATURES  OF  AN  MCDM  METHOD 

Cardinal  assessments  have  to  be  fully  exploited.  Loss  of  information  has  to  be  avoided.  Information 
about  deviations  of  evaluations  between  alternatives  for  each  criterion  has  to  be  used. 

Scale  effects  due  to  different  units  in  which  different  criteria  are  measured  are  to  be  eliminated  in  the 
calculations. 

Pairwise  comparisions  between  alternatives  have  to  lead  to  partial  ranking  (with  incomparabilities)  or  to 
complete  ranking  (without  incomparabilities). 

The  method  (and  calculations)  has  to  be  transparent  (as  “simple”  as  possible)  to  the  decision  maker. 
Technical  parameters  need  to  have  an  interpretation  in  world  of  the  decision  maker. 

Weights  allocated  to  criteria  should  have  a  clear  role  a  straightforward  interpretation  in  the  data 
aggregation  procedure  of  the  MCDM  method,  leading  to  a  ranking  or  a  selection  of  alternatives. 

Incomparability  (conflict)  analysis  should  be  integrated  in  the  method. 

These  features  are  all  present  in  the  PROMETHEE  methods. 

PROMETHEE  INPUT 

Here  is  an  illustration  with  MCDMTool  in  Fig.  2  . 
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TRANSFORMATION  FUNCTIONS 

Transformation  functions  are  used  to  transform  deviations  of  cardinal  evaluations  on  a  (0,1) -interval.  This 
avoids  later  scale  effects  in  the  calculations. 

It  is  recommended  to  use  continuous  transformations  for  data  known  with  a  high  degree  of  accuracy.  This 
avoids  unnecessary  loss  of  information.  For  less  accurately  known  data  or  data  known  with  some  degree 
of  uncertainty,  discontinuous  level-type  transformations  are  recommended. 

Parameters  are  chosen  in  order  to  avoid  loss  of  information  on  the  one  hand  (preference  threshold  [4])  and 
in  order  to  take  into  account  uncertainty  on  the  other  hand  (indifference  threshold  [4]). 

Here  are  some  examples  illustrated  with  MCDMTool. 
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Figure  2:  Performance  transformation  function 
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Figure  3:  Direct  Cost  transformation  function 
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Figure  4:  Maintenance  Cost  transformation  function 


WEIGHTS 

After  transformation  of  the  deviation  between  the  evaluations  of  couples  of  alternatives  a  and  b  on  an 
interval  (0,1)  we  obtain  a  preference  indicator  Pj(a,b)  for  the  criterion  j.  Then  the  aggregation  of  these 

preference  indicators  is  computed  by  ^ a>jP(a,b )  =  n{a,b)  with 

j 

co.  =  w j  /  W  and  W  =  ^  w .  ,  being  the  weight  of  criterion  j .  This  is  a  very  transparent  linear 

j 

additive  aggregation  scheme. 

This  is  illustrated  by  the  following  figures  from  MCDMTool. 
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Figure  5:  Weights 


PROMETHEE  II  RESULTS 

A  complete  ranking  is  obtained  for  each  PROMETHEE  sub-problem  in  the  criteria  hierarchy  and  for  the 
acquisition  project  as  a  whole  by  computing  for  each  alternative  a 

(j){a)  =  (j)+  (a)  -  (/f  (a)  with  </>+  (a)  =  ^  n(a,x)  and  (jf  (a)  =  ^  n(x,a) 

ft  1  x&A-a  ft  1  x&A-a 

where  A  is  the  set  of  all  alternatives  an  n  its  cardinality. 

The  alternatives  are  then  ranked  in  decreasing  order  of  (j){a)  . 

This  is  illustrated  in  Figure  7  with  MCDMTool. 
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Figure  6:  PROMETHEE  II  ranking 


WEIGHT  STABILITY  ANALYSIS 

Due  to  the  linearity  of  the  aggregation  scheme  with  respect  to  the  weights,  the  stability  analysis  vis-a-vis 
the  weights  is  highly  facilitated.  We  refer  to  the  fundamental  discussion  of  this  aspect  of  the  outranking 
methods  in  general  and  of  PROMETHEE  in  particular  in  [8].  This  has  been  implemented  in  the  software 
Decision  Lab  2000  [20]  in  which  there  are  also  some  additional  graphical  representations  based  on  [9] 
which  can  be  helpful  to  understand  the  sensitivity  of  the  final  results  depending  on  the  weights.  This  is  an 
important  issue  in  the  final  discussion  of  the  results  of  the  MCDM  analysis  before  taking  a  decision  in  the 
ranking  or  selection  of  some  military  equipment.  The  stability  of  the  results  as  a  function  of  the  weights  is 
of  course  measuring  also  the  credibility  of  the  decision  which  will  be  based  on  these  results.  This  is  very 
important  in  an  organisation  where  all  members  on  various  levels  will  live  with  the  solution  which  is 
chosen. 

It  should  also  be  noticed  that  instead  of  the  a  posteriori  weight  stability  analysis  in  PROMETHEE,  we 
implemented  in  MCDMTool  a  fully  interactive  module  which  serves  to  determine  a  priori  weights  of 
criteria  by  pairwise  comparison  of  the  importance  of  the  criteria,  and  to  compute  the  weights  compatible 
with  these  pairwise  assessments,  through  an  eigenvalue  method  similar  to  the  computations  which  are 
performed  in  the  background  of  the  AHP  method  of  Saaty  [17].  Both  the  a  priori  and  the  a  posteriori 
module  for  the  discussion  of  the  weights  might  be  interesting  to  be  integrated  in  the  same  software. 
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This  stability  analysis  is  illustrated  by  Figure  8  with  the  use  of  Decision  Lab  2000. 


Figure  8  :  Weight  stability  intervals 

CONCLUSION 

The  PROMETHEE  II  method  is  featuring  all  the  desired  qualities  of  an  MCDM  outranking  method.  As  a 

consequence  it  is  appropriate  to  use  it  in  the  context  of  acquisition  of  military  equipment. 

For  the  discussion  of  the  conflict  analysis  and  the  incomparability  analysis  we  refer  to  the  S AS -080 

contribution  on  “Assessing  and  visualizing  incomparabilities  by  using  an  outranking  method  supporting 

the  acquisition  of  military  equipment”. 
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